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to  pursue  a  graduate  or  Ph.D.  degree  in  science,  mathematics,  engineering,  or  technology  fields: 1  -00 

Number  of  graduating  undergraduates  who  achieved  a  3.5  GPA  to  4.0  (4.0  max  scale): .  3.00 

Number  of  graduating  undergraduates  funded  by  a  DoD  funded  Center  of  Excellence  grant  for 

Education,  Research  and  Engineering: .  o.OO 

The  number  of  undergraduates  funded  by  your  agreement  who  graduated  during  this  period  and  intend  to 

work  for  the  Department  of  Defense .  0.00 

The  number  of  undergraduates  funded  by  your  agreement  who  graduated  during  this  period  and  will  receive 

scholarships  or  fellowships  for  further  studies  in  science,  mathematics,  engineering  or  technology  fields: .  0.00 


Names  of  Personnel  receiving  masters  degrees 

NAME 

Michael  Shomin 

Total  Number: 

1 

Names  of  personnel  receiving  PHDs 

NAME 

Stephen  L.  Smith 

Shaunak  Bopardikar 

Karl  J.  Obermeyer 

Joey  Durham 

Nora  Anyanian 

Ethan  Stump 

Spring  Berman 

Seungkook  Yun 

Carrick  Detweiler 

Total  Number: 

9 

Names  of  other  research  staff 


NAME 

PERCENT  SUPPORTED 

Rebecca  Stein 

0.02 

James  F.  Keller 

0.01 

Aleksandr  Kushleyev 

0.12 

FTE  Equivalent: 

0.15 

Total  Number: 

3 

Sub  Contractors  (DD882) 


Inventions  (DD882) 


Scientific  Progress 


Our  work  over  the  past  five  years  on  the  SWARMS  project  has  included  control  theory,  robotics,  systems  engineering  and 
biology  addressing  swarming  behaviors  in  nature  and  applications  of  biologically-inspired  models  of  swarm  behaviors  to  large 
networked  groups  of  autonomous  vehicles.  The  key  objective  was  to  draw  inspiration  from  biological  paradigms,  to  create  a 
mathematical  basis  for  modeling,  analysis,  and  synthesis  of  swarming  systems,  which  would  be  applicable  to  cooperative 
control  tasks  of  all  types,  including  the  control  of  formations,  the  management  of  sensor  networks,  and  the  dynamics  of 
achieving  a  consensus  in  a  rapidly  changing  environment.  In  particular,  it  is  critical  to  design  algorithms  that  lend  themselves  to 
implementation  in  realistic  swarm  systems  and  that  will  scale  well  with  the  number  of  vehicles  and  devices  present  in  the 
swarm.  Accordingly,  the  Swarms  project  focused  on  four  main  research  thrusts:  modeling  of  group-behaviors  in  biology, 
analysis  of  group  behaviors,  synthesis  of  novel  controllers  for  networked  groups  of  vehicles,  and  experimental  demonstrations 
and  validation.  Multiple  papers  have  been  published  on  the  topic  and  reflect  the  tremendous  progress  we  have  made  over  the 
last  few  years.  They  also  provided  insights  into  different  aspects  of  architecture  design,  controller  synthesis,  and 
communication  protocols  that  will  make  autonomous  groups  of  networked  robots  a  reality. 

Experimental  study  and  modeling  of  group  behaviors 

Berman,  Lindsey,  Kumar  and  Pratt  studied  the  cooperative  behavior  of  ants  engaged  in  collective  transport  tasks  involving  the 
retrieval  of  a  prey  to  the  nest.  Ants  are  able  to  act  independently  with  very  little  apparent  coordination  and  yet  accomplish  the 
complex  tasks  of  cooperative  manipulation  and  transportation  that  an  individual  cannot  accomplish  on  his/her  own.  They  further 
investigated  the  application  of  models  derived  from  ant  behaviors  to  cooperative  manipulation  by  robotic  systems.  In  addition, 
Skelly’s  biological  research  has  turned  increasingly  to  understanding  causes  for  reproductive  deformities  within  amphibians 
living  in  suburban  environments. 

At  a  smaller  scale,  Kumar  and  Pappas  have  studied  behavior  of  bacteria.  One  of  the  great  challenges  in  microscale  science 
and  engineering  is  the  independent  manipulation  of  cells  and  man-made  objects  on  the  micron  scale.  Motile  microorganisms 
are  integrated  with  engineered  systems  to  construct  microbiorobots  (MBRs).  MBRs  are  negative  photosensitive  epoxy  (SU8) 
microfabricated  structures  with  typical  feature  sizes  ranging  from  1-100  pm  coated  with  a  monolayer  of  swarmer  cells  of  the 
bacterium  Serratia  marcescens.  The  adherent  cells  naturally  coordinate  to  propel  the  microstructures  in  fluidic  environments.  In 
this  study,  ultraviolet  light  is  used  to  control  rotational  motion  and  direct  current  electric  fields  are  used  to  control  the 
two-dimensional  movement  of  MBRs.  They  are  steered  in  a  fully  automated  fashion  using  computer-controlled  visual  servoing, 
used  to  transport  and  manipulate  micron-sized  objects,  and  employed  as  cell-based  biosensors.  We  also  developed  an 
experimentally  validated  mathematical  model  for  the  MBRs.  This  model  allows  us  to  use  self  actuation  and  electrokinetic 
actuation  to  steer  the  MBR  to  any  position  and  orientation. 


Rus  has  developed  a  method  for  modeling  animal  interaction  with  the  environment  and  interaction  among  multiple  agents  using 
data  from  smart  collars.  Data  collected  from  cattle  is  used  to  identify  the  parameters  of  the  model  by  least  squares  fitting. 
Techniques  from  Artificial  Intelligence  are  used  to  synthesize  a  herd  model  with  a  realistically  rich  taxonomy  of  behaviors. 

Kumar  and  Pappas  (in  collaboration  with  H.  Rubin)  have  been  engaged  in  modeling  bacterial  colonies  and  their  response  to 
external  stimulii.  Models  range  from  stochastic  models  of  individual  cells  to  deterministic  models  of  ensembles  of  cells.  Most 
recently,  continuous-time  Markov  chain  models  have  been  developed  to  model  the  switching  between  different  behaviors  for 
Lactose  induction  in  E.coli.  This  work  is  leading  to  the  modeling  and  control  of  the  motile  behavior  of  fagellated  bacteria  and 
bacterial  microactuation.  Pappas  has  also  developed  a  novel  identification  technique  based  on  convex  optimization  for  genetic 
regulatory  networks  based  on  genetic  perturbation  data. 

Kumar  (in  collaboration  with  S.  Pratt)  has  worked  on  hierarchical  models  at  the  population  level,  the  group  level  and  the 
individual  level  for  ant  colonies  to  allow  design  and  analysis  of  behaviors  at  different  levels  of  granularity.  Skelly  in  collaboration 
with  other  members  of  the  MURI  team  has  been  developing  a  database  of  collective  behaviors  that  have  both  biological 
significance  and  tactical  importance  for  DoD  applications.  Skelly  and  Rus  have  developed  new  ideas  about  biologically  inspired 
modes  of  construction.  In  addition,  Skelly’s  biological  research  has  turned  increasingly  to  understanding  causes  for 
reproductive  deformities  within  amphibians  living  in  suburban  environments. 

Pappas  and  coworkers  employed  convex  optimization  to  identify  the  gene  interaction  topology  from  steady-state  measurements 
of  the  mRNA  concentrations  of  genes  in  bio-molecular  networks.  This  problem  is  very  important,  not  only  in  promoting 
biological  knowledge,  but  also  in  dug  discovery,  where  a  systems  wide  understanding  of  the  network  is  necessary.  The  novelty 
of  our  approach  was  a  relaxation  of  the  non-convex  sparsity  constraint  (required  if  we  want  to  identify  a  minimal  set  of 
connections)  by  an  iterative  solution  of  convex  approximations  of  the  problem.  We  were  also  able  to  incorporate  prior  biological 
knowledge,  as  well  as  noise  in  the  data.  Our  approach  was  shown  to  perform  particularly  well  on  synthetic  data  as  well  as  on 
data  for  the  SOS  pathway  in  E.coli. 


Kumar  and  Pappas  have  developed  stochastic  models  for  bacterial  swarms  swimming  in  microchannels  and  used  these 
models  to  develop  approaches  controlling  swarms  using  chemotaxis  and  phototaxis. 


Dynamic  Vehicle  Routing  for  Robotic  Systems 


Bullo  et  al  discuss  swarming  of  multiple  autonomous  vehicles  focusing  on  the  planning  of  optimal  routes  for  multiple  vehicles 
performing  different  spatially  distributed  tasks.  The  paper  reviews  the  rich  area  of  dynamic  vehicle  routing  and  provides  a 
framework  derived  from  queuing  theory  and  combinatorial  optimization.  They  establish  fundamental  limits  on  the  achievable 
performance  in  the  setting  where  the  tasks  are  dynamically  generated  by  exogenous  processes. 

The  work  on  dynamic  vehicle  routing  was  completed  by  the  graduation  of  PhD  students  Stephen  L.  Smith  and  Shaunak  D. 
Bopardikar  and  the  publication  of  the  survey  article  in  the  Proceedings  of  the  IEEE.  For  dynamic  vehicle  routing,  our  main 
contributions  are  the  identification  of  (1)  a  novel  tractable  problem  formulation,  (2)  problem  structures  (intrinsic  regimes  in 
parameter  space,  phase  transitions,  etc),  (3)  fundamental  limitations  on  the  achievable  performance,  and  (4)  efficient 
algorithms  with  guaranteed  performance  within  a  constant  factor  of  the  optimum.  In  the  context  of  dynamic  vehicle  routing,  we 
organized  and  delivered  workshops  at  the  2010  ACC  and  the  201 1  RSS  conferences. 

In  the  work  of  PhD  student  Joey  Durham,  we  have  proposed  distributed  algorithms  to  automatically  deploy  a  group  of  mobile 
robotic  agents  to  partition  and  provide  coverage  of  a  non-convex  environment  represented  by  a  graph.  Our  graph  coverage 
algorithm  requires  only  short-range,  unreliable  pairwise  "gossip"  communication  between  the  agents.  The  algorithm  has  two 
parts:  a  motion  protocol  to  ensure  the  robots  communicate  with  their  neighbors,  and  a  pairwise  partitioning  rule  to  update 
territory  when  two  robots  meet. 

Deterministic  Gossiping 

Gossip  algorithms  are  distributed,  asynchronous  algorithms  for  information  exchange  and  computation  in  a  network  of  nodes, 
where  the  nodes  can  be  autonomous  vehicles  in  a  group.  Liu,  Mou,  Morse,  Anderson  and  Yu  have  developed  a  deterministic 
gossip  protocol  that  is  guaranteed  to  always  generate  a  repetitively  complete  gossip  sequence.  The  design  of  such  provably 
correct  deterministic  protocols  with  exponentially  convergent  protocols  has  significant  implications  for  the  design  of  distributed 
control  and  estimation  algorithms  for  groups  of  vehicles,  each  of  which  must  derive  estimates  and  make  decisions 
independently  while  ensuring  consensus  at  the  group  level. 

Morse  has  also  developed  deadlock  free,  efficient  solutions  to  the  distributed  averaging  problem.  Provided  a  complete  solution 
to  the  acyclic  formation  control  problem  which  exhibits  “global  stability"  Provided  a  complete  convergence  proof  for  the  adaptive 
version  of  the  range  only  station  keeping  problem.  Graph  Theoretic  Connectivity  Control  of  Mobile  Robot  Networks  Zavlanos, 
Egerstedt,  and  Pappas  developed  a  mathematical  framework  for  analyzing  groups  of  vehicles  connected  by  a  communication 
network  incorporating  models  of  communication  based  on  proximity.  Their  framework  relies  on  a  graph-theoretic  definition  of 
connectivity  and  the  analysis,  which  leverages  tools  from  algebraic  graph  theory  and  hybrid  systems  theory,  points  to 
approaches  to  controlling  the  network  topology.  Specifically,  they  formulate  control  laws  for  individual  vehicles  that  guarantee 
maintenance  of  the  network,  accomplish  tasks  requiring  rendezvous,  and  swarm  in  group  formations. 

Pappas  et  al  also  established  a  theoretical  framework  for  controlling  graph  connectivity  in  mobile  robot  networks.  We  discuss 
proximity-based  communication  models  composed  of  disk-based  or  uniformly-fading-signal-strength  communication  links.  A 
graph  theoretic  definition  of  connectivity  is  provided,  as  well  as  an  equivalent  definition  based  on  algebraic  graph  theory,  which 
employs  the  adjacency  and  Laplacian  matrices  of  the  graph  and  their  spectral  properties.  Based  on  these  results,  we  discuss 
centralized  and  distributed  algorithms  to  maintain,  increase,  and  control  connectivity  in  mobile  robot  networks.  The  various 
approaches  discussed  in  this  paper  range  from  convex  optimization  and  subgradient  descent  algorithms,  for  the  maximization 
of  the  algebraic  connectivity  of  the  network,  to  potential  fields  and  hybrid  systems  that  maintain  communication  links  or  control 
the  network  topology  in  a  least  restrictive  manner.  Common  to  these  approaches  is  the  use  of  mobility  to  control  the  topology  of 
the  underlying  communication  network.  We  discuss  applications  of  connectivity  control  to  multi-robot  rendezvous,  flocking  and 
formation  control,  where  so  far,  network  connectivity  has  been  considered  an  assumption. 

Decentralized  Control  for  the  Deployment  of  Robotic  Camera  Networks  Schwager,  Julian,  Angermann,  and  Rus  developed 
decentralized  control  policies  for  a  group  of  aerial  robots  monitoring  a  specified  area  with  cameras  in  a  surveillance  application. 
The  cost  function  is  derived  from  a  model  of  a  downward  facing  camera  and  is  designed  to  maximize  the  number  of  pixels  per 
unit  area  across  the  group.  Each  robot  follows  a  gradient  control  law  that  ensures  the  group  coverage  is  maximized  and  has 
guarantees  on  convergence  and  stability.  Results  are  presented  in  simulation  as  well  as  in  experimentation  with  a  testbed  of 
multiple  quad  rotor  robots  (autonomous  helicopters  with  four  rotors). 

Rus  et  al  have  also  developed  a  distributed  control  algorithm  to  command  a  group  of  robots  to  explore  an  unknown 
environment  while  providing  adaptive  sensor  coverage  of  interesting  areas  within  the  environment.  This  algorithm  has  many 
applications  in  controlling  teams  of  robots  to  perform  tasks  such  as  search  and  rescue  missions,  environmental  monitoring, 
automatic  surveillance  of  rooms,  buildings,  or  towns,  or  simulating  collaborative  predatory  behavior.  This  work  extends  our 


previous  results  on  coverage  developed  as  part  of  this  project  by  removing  restrictions  on  the  weighting  function,  so  that  a 
much  broader  class  of  weighting  functions  can  be  provably  approximated.  Typically,  the  form  of  the  weighting  function  isn’t 
known  a  priori,  and  if  this  isn’t  accounted  for  directly  then  the  learning  algorithm  could  chatter  between  models  or  even  become 
unstable.  In  simulations  performed  with  a  realistic  weighting  function,  the  original  algorithm  only  explores  in  a  local 
neighborhood  of  the  robots  resulting  in  a  poor  approximation  of  the  weighting  function.  However,  the  new  algorithm  explores 
the  entire  space,  successfully  learning  the  weighting  function  with  provable  robustness.  In  the  new  algorithm,  the  robots 
partition  the  environment  and  perform  a  distributed  exploration  algorithm  so  that  the  unknown  weighting  function  can  be 
adequately  approximated.  They  then  switch,  in  an  asynchronous  and  distributed  fashion,  to  a  coverage  mode  in  which  they 
deploy  over  the  environment  to  achieve  positions  that  are  advantageous  for  sensing.  The  robots  use  an  on-line  learning 
mechanism  to  approximate  the  weighting  function.  Since  we  do  not  assume  that  the  robots  can  perfectly  approximate  the 
weighting  function,  the  parameter  adaptation  law  for  learning  this  function  must  be  carefully  constructed  to  be  robust  to  function 
approximation  errors.  Without  specifically  designing  for  such  robustness,  it  is  known  that  many  different  types  of  instability  can 
occur.  There  are  many  different  techniques  that  have  been  proposed  in  the  adaptive  control  literature  to  handle  this  kind  of 
robustness,  including  using  a  dead-zone,  the  s-modification,  and  the  e-modification.  Specifically,  we  chose  the  dead  zone 
technique  and  prove  that  the  robots  learn  a  function  that  has  bounded  difference  from  the  true  function,  while  converging  to 
positions  that  are  locally  optimal  for  sensing  with  respect  to  the  learned  function.  We  have  implemented  the  algorithm  using  a 
decentralized  swarm  of  6  iCreate  robots  with  light  sensors. 

Cooperative  and  Non-cooperative  Operations  of  Robotic  Sensor  Web  Swarms  Chung,  Oh,  Shim  and  Sastry  review  recent 
advances  in  wireless  sensor  networks  and  their  evolution  into  robotic  sensor  webs  which  are  heterogeneous  collections  of 
stationary  and  mobile  sensors  including  robots.  In  particular,  they  discuss  the  cooperative  control  of  networked  unmanned 
aerial  algorithms  in  tasks  as  pursuit  and  tracking  and  navigation  in  groups.  Their  paper  includes  novel  ideas  on  system 
architecture,  the  design  of  model  predictive  controllers  for  multiple  unmanned  aerial  vehicles  and  cooperative  localization  using 
multiple  cameras  on  stationary  or  mobile  nodes. 

Technology  trends  point  towards  a  fusion  of  wireless  sensor  networks  with  robotic  swarms  of  mobile  robots.  Sastry  et  al  have 
also  studied  the  coordination  and  collaboration  between  networked  robotic  systems,  featuring  algorithms  for  cooperative 
operations  such  as  unmanned  aerial  vehicles  (UAVs)  swarming.  We  have  developed  cooperative  actions  of  groups  of  agents 
such  as  probabilistic  pursuit-evasion  game  for  search  and  rescue  operations,  protection  of  resources,  and  security  applications. 
We  have  demonstrated  a  hierarchical  system  architecture  which  provides  wide-range  sensing  capabilities  to  unmanned 
vehicles  through  spatially  deployed  wireless  sensor  networks,  highlighting  the  potential  collaboration  between  wireless  sensor 
networks  and  unmanned  vehicles.  This  work  also  includes  a  short  review  of  our  current  research  efforts  in  heterogeneous 
sensor  networks,  which  is  being  evolved  into  mobile  sensor  networks  with  swarm  mobility.  In  a  very  essential  way,  this 
represents  the  fusion  of  mobility  of  ensembles  with  the  network  embedded  systems,  the  robotic  sensor  web. 

Control  of  Ensembles  of  Aerial  Robots 

Michael  and  Kumar  have  addressed  the  problem  of  swarming  with  multiple  unmanned  aerial  vehicles.  They  consider 
abstractions  of  groups  where  large  collections  are  represented  by  a  group  of  shape  and  position/orientation  variables  that  have 
the  structure  of  a  low-dimensional  manifold.  They  describe  the  swarming  task  on  this  low  dimensional  manifold  and  synthesize 
decentralized  controllers  that  achieve  the  swarming  task  with  proofs  of  convergence.  They  also  show  experimental  and 
simulation  results  on  a  team  of  multiple  quad  rotors. 

For  smaller  teams,  Ayanian  and  Kumar  have  also  worked  towards  implementing  automatically  synthesized  controller  for 
multirobot  coordination  on  a  group  of  quadrotors.  In  an  environment  with  obstacles,  we  automatically  synthesize  controllers  with 
guarantees  on  collision  avoidance,  maintenance  of  desired  inter-robot  constraints,  and  convergence.  We  do  this  by 
decomposing  the  workspace  into  obstacle-free  cells,  taking  the  Cartesian  product  of  the  robots'  workspaces,  and  removing 
from  the  resulting  space  all  coordinates  which  violate  the  set  constraints  (collision,  communication,  etc.).  This  space  is 
composed  of  polytopes,  on  which  we  plan  a  discrete  path  to  the  goal.  On  each  pair  of  polytopes  until  the  goal  polytope,  we 
synthesize  a  navigation  function  which  drives  the  system  to  the  next  polytope  in  the  sequence.  We  have  successfully 
implemented  the  controller  on  a  single  quadrotor,  and  plan  to  implement  it  on  a  group  of  quadrotors. 

Constraint-aware  Construction. 

Rus  et  al  have  introduced  a  constraint-aware  decentralized  approach  to  construction  with  swarms  of  robots.  We  aim  to  create 
complex  structures  using  heterogeneous  sets  of  robots  and  parts.  We  abstract  this  process  using  tool  delivery  and  assembly 
robots;  delivery  robots  pick  up  parts  and  carry  them  from  some  part  source  into  the  construction  site  where  assembly  robots 
perform  actuation  tasks  to  add  the  parts  to  the  structure.  In  our  previous  work  we  developed  a  set  of  adaptive  algorithms  for 
constructing  truss  structures  given  a  target  geometry,  and  demonstrated  their  feasibility  experimentally.  This  research  extends 
that  work  in  two  ways:  first,  by  developing  a  novel  partitioning  algorithm  that  uses  a  detailed  description  of  the  target  structure 
rather  than  a  target  geometry  to  distribute  tasks  among  robots;  second,  by  introducing  a  distributed  algorithm  for  delivering 


parts  in  order  to  conform  to  physical  constraints  such  as  the  stability  of  the  structure  and  the  ability  of  robots  to  reach  areas  in 
the  structure.  If  we  imagine  the  construction  of  a  building,  there  is  a  strong  natural  set  of  constraints  on  the  build  order.  These 
fall  into  two  major  categories:  (1)  physical  constraints  require  supporting  structures  be  set  up  first:  one  must  lay  a  foundation 
before  a  wall,  and  the  first  floor  before  the  second;  (2)  reachability  constraints  require  that  construction  not  block  pending  work: 
plumbing  and  electrical  is  installed  between  studs  before  drywall  encloses  the  space,  though  neither  rely  on  each  other  for 
support.  Our  research  on  constraint-aware  construction  addresses  the  problem  of  representing  and  conforming  to  both  of  these 
classes  of  constraints,  and  determining  ways  to  maximize  and  automate  parallelism.  More  specifically,  we  are  given  a  team  of 
robots,  a  blueprint  of  a  desired  structure,  and  a  construction  region  Q.  A  subset  of  n  of  the  robots  are  specialized  as  assembly 
robots  and  the  rest  are  specialized  as  delivery  robots.  The  blueprint  describes  the  location,  type,  and  physical  requirements  for 
stability  of  each  object  (“part”)  in  the  structure.  The  robots  are  given  a  local  section  of  a  blueprint,  and  have  full  knowledge  of 
the  progress  of  the  construction  of  the  target  structure  in  the  area  surrounding  them  and  their  neighbors.  Our  new  algorithm 
coordinates  the  construction  of  a  given  structure  while  maximizing  parallelism  across  assembly  robots  and  conforming  to  the 
physical  constraints  of  the  structure.  The  algorithm  is  guaranteed  to  construct  the  structure  in  an  order  that  is  feasible  in  that  it 
does  not  prevent  any  sub-assembly  from  being  completed.  We  have  implemented  the  algorithms  using  an  experimental  setup 
of  2  assembly  and  2  delivery  robots.  Our  experimental  setup  used  the  robots  to  build  multi-layer  boxes  to  test  physical 
constraints.  Our  experimental  setup  used  the  robots  to  build  multi-layer  boxes  to  test  physical  constraints,  and  rows  of  boards 
to  test  reachability  constraints.  The  robots  were  built  using  the  iCreate  robot  base  and  Crustcrawler  arms  with  specialized 
grippers. 

Optimal  Periodic  Patrolling  Trajectories  of  UUVs  Guarding  a  Channel 

Given  a  number  of  patrollers,  the  channel  patrol  problem  consists  of  determining  the  periodic  trajectories  that  the  patrollers 
must  trace  out  so  as  to  maximize  the  probability  of  detection  of  the  intruder.  Sastry’s  group  has  formulated  this  problem  as  an 
optimal  control  problem.  We  assume  that  the  patrollers’  sensors  are  imperfect  and  that  their  motions  are  subject  to  turn-rate 
constraints,  and  that  the  intruder  travels  straight  down  a  channel  with  constant  speed.  Using  discretization  of  time  and  space, 
we  approximate  the  optimal  control  problem  with  a  large-scale  nonlinear  programming  problem  which  we  solve  to  obtain  an 
approximately  stationary  solution  and  a  corresponding  optimized  trajectory  for  each  patroller.  In  numerical  tests,  we  obtain  new 
insight  -  not  easily  obtained  using  geometric  calculations  -  into  efficient  patrol  trajectory  design  for  up  to  two  patrollers  in  a 
narrow  channel  where  interaction  between  the  patrollers  is  unavoidable  due  to  their  limited  turn  rate. 

Analysis 

Morse  has  addressed  the  analysis  of  formations,  the  management  of  sensor  networks,  and  the  dynamics  of  achieving  a 
consensus  in  a  rapidly  changing  environment.  This  approach  is  based  upon  the  combined  use  of  graph  theory  and  the  theory  of 
dynamical  systems  which  as  an  approach  to  swarming  analysis/synthesis  is  very  much  in  an  early  stage  of  development.  By 
developing  the  tools  to  analyze  and  synthesize  swarm  behaviors,  we  are  contributing  to  the  growing  knowledge  base,  which  will 
be  required  to  eectively  deploy  large  groups  of  mobile  autonomous  agents  and  sensors. 

Jadbabaie  and  Sastry  addressed  provably  correct  analysis  of  distributed  optimization  based  control  algorithms  such  as 
distributed  Model  Predictive  Control  (MPC).  While  there  has  been  success  stories  in  implementation  for  distributed  Model 
Predictive  Controllers,  the  key  theoretical  questions  have  been  more  or  less  open.  To  address  this  void  a  research  plan  has 
been  devised,  which  uses  ideas  from  Multi-Parametric  Quadratic  Programming  and  operator  theory  to  develop  a  rigorous 
theory  for  distributed  MPC.  Specifically,  the  contributions  in  this  area  have  been  twofold:  On  one  hand,  recent  results  on 
infinite-horizon  optimal  control  of  spatially  invariant  systems  have  been  extended  to  finite  receding  horizon  control  with  input 
and  state  constraints.  On  the  other  hand,  the  produced  results  can  be  interpreted  as  an  extension  of  the  finite  dimensional  Multi 
Parametric  Quadratic  Programming-based  analysis  of  receding  horizon  control  to  distributed,  spatially  invariant  systems.  It  is 
assumed  that  the  dynamics  of  each  subsystem  is  uncoupled  to  the  others,  but  the  coupling  appears  through  the  infinite  horizon 
cost  function.  Specifically,  it  was  proven  that  for  spatially  invariant  systems  with  constraints,  optimal  receding  horizon  controllers 
are  piece-wise  affine  (represented  as  a  convolution  sum  plus  an  offset).  Moreover,  the  kernel  of  each  convolution  sum  decays 
exponentially  in  the  spatial  domain  mirroring  the  unconstrained  infinite-horizon  case.  Furthermore,  in  another  work,  these 
results  have  been  extended  to  the  case  were  dynamics  are  heterogeneous  and  the  underlying  graph  does  not  possess  any 
group  structure,  but  still  the  underlying  centralized  solution  has  an  inherently  decentralized  architecture,  meaning  that  the 
amount  of  information  needed  from  the  neighbors  decays  exponentially  in  a  distance  metric  defined  over  the  graph.  Using  the 
framework  of  dual  Lyapunov  techniques,  we  were  able  to  derive  density  functions  for  navigation  function  based  systems  which 
provide  a  tool  for  controller  composition  due  to  their  convexity  properties. 

Bullo  has  worked  on  models,  algorithms  and  analysis  tools  with  the  objective  to  tackle  complexity  and  achieve  scalability  in 
SWARMS  networks.  We  obtained  two  sets  of  notable  results.  First,  we  designed  task  allocation  algorithms  with  optimal 
asymptotic  performance  in  environment  with  varying  degrees  of  communication  services.  Second,  we  designed  cooperative 
pursuit  strategies  for  multi-pursuers/evader  games  in  scenarios  with  limited  sensing  abilities  and  with  motion  constraints. 


Pappas  and  co-workers  derived  fundamental  results  in  connectivity  control,  and  applied  and  extended  to  multi-robot  tasks  that 
require  connectivity  for  completion.  One  such  task  is  flocking  of  multiple  agents.  Velocity  alignment  critically  depends  on  the 
connectivity  specification.  The  great  challenge  in  these  tasks  is  the  integration  of  continuous  motion  planning  with  control  in  the 
discrete  space  of  networks  and  graphs.  We  were  able  to  address  this  challenge  by  developing  distributed  hybrid  controllers  for 
the  robots  that  jointly  ensured  connectivity  as  well  as  flocking  behavior  of  the  swarm. 

On  a  similar  vein,  we  employed  graph  theory  and  distributed  optimization  to  address  network  design  and  identification  issues 
for  consensus  and  gene  expression  respectively.  In  the  former  case,  we  developed  a  distributed  algorithm  to  obtain  the  edge 
weights  of  a  Markov  chain  with  fastest  mixing  rate.  This  algorithm  relied  on  consensus  of  appropriately  sampled  instances  of 
the  Markov  chain.  Probabilistic  guarantees  were  also  provided.  This  result  has  many  applications  in  scenarios  where  multiple 
observers  need  to  create  a  probabilistic  map  of  the  traffic  in  an  environment  of  interest.  Fast  mixing  Markov  chains  are 
important  for  algorithm  performance. 

Synthesis 

This  thrust  is  closely  linked  to  the  modeling  and  analysis  thrusts.  Biological  behaviors  that  are  deemed  to  be  of  interest  have 
been  modeled  and  analyzed  for  performance.  In  this  thrust,  the  problem  of  systematically  design  agent  behaviors  to  realize  the 
right  behaviors  is  addressed.  Thus  models  of  herds,  ants,  and  bacteria  serve  as  inspiration  for  the  synthesis  of  controllers  for 
robots. 

Specifically,  vision-based  control  laws  have  been  developed  in  the  scope  of  the  project,  that  use  visual  servoing  by  bearing, 
optical  flow  and  time  to  collision  measurements  for  2D  and  3D  coordination.  Another  focus  in  the  project  is  to  synthesize 
distributed  control  laws  that  maintain  and  optimize  connectivity  of  the  network  in  a  distributed  fashion.  As  recent  results 
suggested  that  the  behavior  of  the  vehicle  swarm  is  directly  related  to  a  quanti^able  measure  of  connectivity  of  the  underlying 
proximity  graph,  a  distributed  protocol  has  been  developed  which  optimizes  the  connectivity  of  the  multiagent  system  by 
implementing  a  super-gradient  algorithm  that  tries  to  locally  optimize  the  second  smallest  eigenvalues  of  the  state  dependent 
graph  Laplacian. 

In  addition,  Jadbabaie  and  Koditschek  have  developed  a  formalism  for  construction  of  decentralized  navigation  functions,  and 
controllers  that  that  minimize  this  function  whose  minimum  is  the  desired  configuration. 

We  have  derived  (weak)  Input-to-State  stability  properties  of  navigation  function  based  systems,  which  will  allow  us  to  formally 
study  the  interconnection  stability  characteristics  of  multiple  agents  and  use  the  input-to-state  stability  property  as  a  synthesis 
tool. 

The  synthesis  of  controllers  for  a  swarm  of  robots  has  been  addressed,  to  generate  a  desired  two-dimensional  geometric 
pattern  specified  by  some  simple  closed  planar  curve,  considering  local  interactions  for  collision  avoidance  and  maintaining 
specified  relative  distance  constraints.  The  controllers  are  decentralized  in  the  sense  that  the  robots  do  not  exchange  or  sense 
each  other’s  state  information.  However,  we  assume  that  the  robots  have  range  sensors  allowing  them  to  obtain  information 
about  distances  to  neighbors  within  a  known  range.  We  establish  stability  and  convergence  properties  of  the  controllers. 

Pappas  has  worked  on  distributed  control  of  multiagent  systems  with  applications  are  related  to  assignment  problems  as  well 
as  control  of  connectivity  of  mobile  networks.  The  proposed  approaches  extend  from  gradient  flows  on  appropriately  defined 
potential  fields  to  hybrid  dynamical  systems.  Notions  from  algebraic  graph  theory  were  also  used  and  provided  significant 
modeling  tools. 

Rus  and  co-workers  have  generated  a  number  of  new  results,  both  theoretical  and  experimental,  in  deploying  groups  of  robots 

using  decentralized  controllers.  We  developed  a  new  theory  under  which  several  previously  separate  notions  of  multi-robot 

deployment  were  unified  as  different  instances  of  distributed  optimization  of  a  particular  cost  function.  Specifically,  we  showed 

that  geometric  robot  deployment  methods  based  on  Voronoi  decompositions,  probabilistic  methods  based  on  maximizing 

detection  likelihood  or  minimizing  measurement  variance,  and  artificial  potential  field  based  methods  in  which  robots  push  away 

from  each  other  by  following  the  negative  gradient  of  potential  fields  can  all  be  derived  as  distributed  gradient  descent  on  the 

same  cost  function.  The  cost  function  has  three  main  components  that  can  be  specialized  to  produce  these  different 

deployment  methods,  as  well  as  many  other  kinds  of  multi-robot  deployment  schemes.  This  unified  approach  highlights  the 

commonalities  of  these  methods,  each  of  which  was  developed  separately  in  the  literature  using  rather  different  models  of  the 

underlying  problem. 

The  unified  cost  function  provokes  questions  about  the  limits  of  general  optimization  based  multi-robot  deployment.  For 
example,  we  proved  that  there  is  an  inherent  connection  between  the  convexity  of  a  multi-robot  cost  function  and  the 
multi-robot  phenomenon  of  consensus  (in  which  all  robots  meet  at  a  common  point,  also  known  as  rendezvous).  Specifically, 
we  proved  that  if  we  desire  a  group  of  robots  to  do  some  task  that  is  not  consensus  (i.e.  that  can  not  be  accomplished  by  all 


robots  driving  to  the  same  point),  the  underlying  cost  function  for  the  task  must  be  nonconvex.  This  is  important  because 
nonconvex  cost  functions  are  potentially  more  difficult  to  optimize  than  convex  ones,  especially  in  a  multi-robot  context  where 
the  optimization  must  be  distributed  over  a,  ad  hoc  robot  network.  This  work  was  presented  at  the  International  Symposium  on 
Robotics  Research  (ISRR)  in  August,  2009,  after  which  it  was  selected  as  one  of  the  best  papers  of  the  conference  and  was 
submitted  to  a  special  issue  of  the  International  Journal  of  Robotics  Research  (IJRR)  in  January,  2010. 

This  new  multi-robot  deployment  theory  led  to  several  algorithmic  and  experimental  advances.  For  example,  we  developed 

decentralized  controllers  based  on  this  theory  to  enable  distributed  construction,  in  which  a  team  of  robots  constructs  a 

structure  in  a  distributed  way  based  on  high  level  plans.  The  distributed  construction  algorithm  was  presented  at  the 

International  Symposium  on  Robotics  Research  (ISRR)  in  August,  2009.  We  also  developed  decentralized  controllers  to  deploy 

underwater  sensor  nodes  in  an  acoustic  underwater  sensor  network.  The  nodes  use  a  distributed  gradient  optimization  scheme 

to  move  themselves  up  and  down  along  tethers  anchored  to  the  sea  floor  in  order  to  best  measure  the  ocean  around  them.  The 

controller  was  successfully  tested  experimentally  on  a  network  of  underwater  sensor  nodes.  This  work  was  accepted  for 

presentation  at  the  ACM  Conference  on  Networking  Sensors  and  Systems  (SenSys)  in  November  of  2010.  We  also  used  a 

distributed  gradient  method  to  design  controllers  for  aerial  vehicles  to  act  as  communication  relays  for  ground  vehicles  in  an  ad 

hoc  network.  The  aerial  vehicles  position  themselves  to  optimize  a  measure  of  the  signal  quality  in  the  network  using  a  realistic 

model  of  the  signal  to  interference  ratio.  The  controller  was  implemented  experimentally  on  a  group  of  flying  quadrotor  robots, 

and  was  presented  at  the  International  Conference  on  Robotics  and  Automation  (ICRA)  in  May  of  2010.  Finally,  we  also 

developed  an  algorithm  for  positioning  robots  for  distributed  surveillance  with  on-board  cameras  to  optimize  a  metric  related  to 

maximize  the  amount  of  information  captured  in  the  environment  The  algorithm  works  with  heterogeneous  groups  of  robot-born 

cameras  in  which  the  cameras  may  have  different  optical  properties,  and  the  robots  may  have  different  modes  of  mobility  (e.g. 

some  cameras  may  be  mounted  in  a  fixed  position  but  able  to  swivel  in  place,  while  others  may  be  fixed  to  flying  robots  with  a 

full  six  degrees  of  freedom).  The  algorithm  was  successfully  implemented  a  group  of  five  flying  quadrotor  robots  over  an  ad  hoc 

network  operating  outdoors  in  a  fully  autonomous  fashion.  Repeated  experiments  were  carried  out  with  the  five  quadrotors  to 

prove  robustness  under  realistic  operating  conditions.  The  algorithm  and  experiments  were  submitted  to  a  special  issue  of  the 

Proceedings  of  the  IEEE  (the  flagship  journal  of  the  IEEE),  in  May  2010. 

Sastry  and  co-workers  have  developed  methods  using  Outer  Approximations  as  an  External  Active  Set  Strategy.  Outer 
approximations  are  a  well  known  technique  for  solving  semi-infinite  optimization  problems.  We  show  that  a  straightforward 
adaptation  of  this  technique  results  in  a  new,  external,  active-set  strategy  that  can  easily  be  added  to  existing  software 
packages  for  solving  nonlinear  programming  problems  with  a  large  number  of  inequality  constraints.  Our  external  active-set 
strategy  is  very  easy  to  implement,  and,  as  our  numerical  results  show,  it  is  particularly  effective  when  applied  to  discretized 
semi-infinite  optimization  or  state-constrained  optimal  control  problems.  Its  effects  can  be  spectacular,  with  reductions  in 
computing  time  that  become  progressively  more  pronounced  as  the  number  of  inequalities  is  increased. 

Further  his  group  has  derived  results  on  the  optimal  detection  of  an  underwater  intruder.  Given  a  number  of  patrollers  that  are 
required  to  detect  an  intruder  in  a  channel,  the  channel  patrol  problem  consists  of  determining  the  periodic  trajectories  that  the 
patrollers  must  trace  out  so  as  to  maximized  the  probability  of  detection  of  the  intruder.  We  formulate  this  problem  as  an  optimal 
control  problem.  We  assume  that  the  patrollers’  sensors  are  imperfect  and  that  their  motions  are  subject  to  turn-rate 
constraints,  and  that  the  intruder  travels  straight  down  a  channel  with  constant  speed.  Using  discretization  of  time  and  space, 
we  approximate  the  optimal  control  problem  with  a  large-scale  nonlinear  programming  problem  which  we  solve  to  obtain  an 
approximately  stationary  solution  and  a  corresponding  optimized  trajectory  for  each  patroller.  In  numerical  tests  for  one,  two, 
and  three  underwater  patrollers,  an  underwater  intruder,  different  trajectory  constraints,  and  several  intruder  speeds,  we  obtain 
new  insight  —  not  easily  obtained  using  simply  geometric  calculations  —  into  efficient  patrol  trajectory  design  for  multiple 
patrollers  in  a  narrow  channel  where  interaction  between  the  patrollers  is  unavoidable  due  to  their  limited  turn  rate. 

Their  work  has  also  led  to  advances  in  multi-agent  cooperative  and  non-cooperative  sensing  and  operation  in  dynamic 
environments. 

Technology  trends  point  towards  a  fusion  of  wireless  sensor  networks  with  robotic  swarms  of  mobile  robots.  In  this  work,  we 
discuss  the  coordination  and  collaboration  between  networked  robotic  systems,  featuring  algorithms  for  cooperative  operations 
such  as  UAV  swarming.  We  have  developed  cooperative  actions  of  groups  of  agents  such  as  probabilistic  pursuit  evasion 
game  for  search  and  rescue  operations,  protection  of  resources,  and  security  applications.  We  have  demonstrated  a 
hierarchical  system  architecture  which  provides  wide-range  sensing  capabilities  to  unmanned  vehicles  through  spatially 
deployed  wireless  sensor  networks,  highlighting  the  potential  collaboration  between  wireless  sensor  networks  and  unmanned 
vehicles.  This  work  also  includes  a  survey  of  our  current  research  efforts  in  heterogeneous  sensor  networks,  which  is  being 
evolved  into  mobile  sensor  networks  with  swarm  mobility.  In  a  very  essential  way,  this  represents  the  fusion  of  mobility  of 
ensembles  with  network  embedded  systems. 

Kumar  and  his  students  have  develop  methods  to  maintain  connectivity  using  a  network  of  aerial  and  ground  robots  exploiting 
models  of  line-of-sight  connectivity  and  models  that  capture  fading  and  shadowing.  In  collaborations  with  ARL  researchers  they 
have  developed  new  models  and  control  algorithms  that  enable  robots  to  concurrently  solve  the  problems  of  routing  packets 


and  control. 


Kumar  and  Pappas  have  developed  bacteria-powered  micro-robots  that  swim  through  microchannels  influenced  by  chemicals 
in  the  environment.  These  proof  of  concept  prototypes  point  to  microrobots  that  can  sense  the  environment  and  deliver  drugs. 
Kumar  and  Michael  have  developed  a  framework  and  robot  controllers  that  enable  a  group  of  aerial  robots  to  maintain  a 
formation  with  partial  state  information  while  avoiding  collisions.  The  central  idea  is  to  develop  a  low-dimensional  abstraction  of 
the  large  teams  of  robots,  facilitating  planning,  command  and  control  in  a  low-dimensional  space,  and  to  realize  commands  or 
plans  in  the  abstract  space  by  synthesizing  controllers  for  individual  robots  that  respect  the  specified  abstraction.  We  derive  the 
basic  theory  and  present  experimental  and  simulation  results  with  a  team  of  rotor  crafts. 

Technology  Transfer 


